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(57) ABSTRACT 

A direct comparison adaptive halting turbo decoder com- 
putes the sum of the a priori and the extrinsic information 
sequences at each iteration step. The sum sequences are 
coded so as to be simple binary sequences. New sum 
sequences are generated during each iteration and used to 
estimate the state of the convergence without resorting to use 
of transmitted error detection codes. The adaptive halting 
turbo decoder is halted when the sum sequences generated 
in a single iteration step produce identical binary sequences, 
i.e. a change in the sum sequence is observed during the 
iteration and when there is no more change, the iteration is 
halted. 
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DIRECT COMPARISON ADAPTIVE W-CDMA Mobile Radio, Proc IEICE General Conf., B-5- 

HALTING DECODER AND METHOD OF USE 109, vol. 1, pp. 541, March 1999 (in Japanese), and incor- 

porated by reference herein, have shown the effectiveness of 
RELATED PATENT APPLICATION the foregoing iterative turbo decoding process. 

rpi • ,. i * a * ci a no ~ n *—i 1: 5 If a transmitted sequence is not encoded with the CRC 

This application is related to co-filed U.S. patent apph- . - «... . . . , . , 

cation entitled CRC-based Adaptive Halting Decoder and fte foregomg technique of Shrbntan. et al. cannot be 

Method of Use, application Ser. No. 09/547.815. W 1 » d . ^"^n*/ .L T T ^V**" 

encoded with the CRC code, the associated receiver decoder 

BACKGROUND OF THE INVENTION must a P^ori know the generator polynomial of the CRC 

10 code and the position of its redundancy check words in the 

1. Field of the Invention This invention relates generally received sequence. This limitation makes the design of the 
to iterative turbo decoding, and more particularly to adaptive decoder complicated for variable rate data communications, 
halting algorithms that reduce computational complexity of In j Hagenauer, E. Offer, and L. Papke, Iterative Decod- 
iterative turbo decoders. ing of Binary Block and Convolutional Codes, IEEE Trans. 

2. Description of the Prior Art 15 Inf. Theory, vol. 42, pp. 429-445, March 1996 and in U.S. 
Turbo code is well known computational tool that was Pat. No. 5,761,248, entitled Method and Arrangement for 

proposed in 1993 and that attracted the attention of research- Determining an Adaptive Abort Criterion in Iterative Decod- 
ers and developers, especially in the art of communication ing of Multi-dimensionally Coded Information, by J. 
engineering. C. Berrou, A. Glavieux, and P. Thitimajshima, Hagenauer and F. Burkert, issued June 1998, both references 
Near Shannon Limit Error-correcting Coding and Decoding: 20 incorporated herein by reference, Hagenauer et al. have 
Turbo Codes (I), Proc.ICC '93, pp. 1064-1070, May 1993. shown implementation of the adaptive halting algorithm 
The Berrou et al. reference is incorporated by reference without resorting to use of the transmitted CRC code. The 
herein. A turbo encoder is composed of two recursive adaptive halting algorithm of Hagenauer et al. makes use of 
systematic convolutional (RSC) encoders and an interleaver the difference sequence between two soft output sequences 
to generate the interleaved version of an input information determined at the iteration step as well as the preceding 
sequence. The interleaved sequence is also encoded using iteration step and derived at each iteration step. Then the Lj 
one of the RSC encoders. The resultant turbo code, using norm of the difference sequence (cross entropy of the two 
parallel concatenation of the two RSC codes, has a substan- soft output sequences) is calculated at each iteration step, 
tially large free Hamming distance and therefore provides a Once the cross entropy of the two soft output sequences 
powerful error correcting code. The aforesaid Hamming 30 becomes less than a predetermined threshold value, the 
distance can be further improved by employing long inter- iteration process is halted. Although the techniques devel- 
leavers a the expense of larger memory capacity. oped by Hagenauer et al. do not require use of the trans- 

FIG. 4 is a simplified block diagram of a parallel- mittcd CRC me technique otherwise requires an extra 

concatenated rate 1/3 turbo encoder. A parallel-concatenated 35 lar S e memory capacity to store the soft output sequence data 

turbo encoder has two or more component encoders in at each preceding iteration step. This is so since the soft 

conjunction with one or more interleaves A component out P u j sequence of a typical turbo decoder is very long and 

encoder CI to create a parity sequence XI encodes an input therefore has soft out P* s y mbok Wlth lon g ™> rd kitfhs. 

information sequence. Hie input information sequence is Further > the aforementioned cross entropy needs to be com- 

interleaved and then encoded by C2 to create a second parity ^ P uted usin S accurac ? * ord f r to accurately detect the 

sequence X2. The information sequence and the two parity convergence of iterative decoding, which significantly 

sequences are then multiplexed to create a coded sequence. increases the hardware size of the multiplier used for the 

The foregoing two RSC codes are alternately MAP- calculation of the ^ norm, 
decoded in the turbo decoder, and the reliability of the soft * Robertson, Illuminating the Structure of Parallel Con- 
output of the MAP decoder is iteratively updated. The sign 45 catenated Recursive Systematic (TURBO) Codes, Proc. 
of the soft output is improved as a decoded output following GLOBECOM'94, pp. 1298-1303, November 1994, incor- 
a sufficient number of iteration steps. The amplitude of the P orated b Y reference herein, proposes application of the 
soft output gradually increases during the iteration process. adaptive halting algorithm using the variance of the soft 
However, the sign generally remains constant after several 0Ut P ut sequence as the halting criterion. Although the Rob- 
iteration steps. Thus, it is easy to recognize a decoded output so ertson technK l ue does not rec I uire ™ extra lar S e memory 
can become error-free in just a few iteration steps for capacity or a large multiplier such as required when using 
low-noise channels having a channel-decoded bit error rate the foregoing cross entropy computation methods, the tech- 
(BER) as low as 10"*. Detection of an error-free decoded ni q ue of Robertson nonetheless requires additional multi- 
sequence can significantly reduce computational complexity P lier hardware to calculate the variance. The requirement for 
since the iteration process can then be halted without requir- 55 a multiplier is disadvantageous for low power and low-cost 
ing further iteration computations. silicon implementations since the additional hardware will 

Atransmitted sequence is generally encoded with an error ™™ c bo * and P ower requirements necessary to 

detection code such as the familiar cyclic redundancy check implement the adaptive halting algorithm. 

(CRC) code disclosed by S. Lin and D. J. Costello Jr., Error In view of the foregoing, a need exists in the communi- 

Control Coding: Fundamentals and Applications, Prentice 60 cation art for an adaptive halting structure and method that 

Hall, N.J., 1983, and incorporated herein by reference. The does not require use of the passively embedded CRC code 

above error-free decoding can then be checked for accuracy and that does not require surplusage multipliers or memory 

at the receiver side using the CRC code; and when error-free capacity. 

decoding is detected during an iteration, the remaining crun^nv nr tuc Tm/cwrTrvvr 

portion of the iteration can either be ignored or completely 65 SUMMARY OF THE INVENTION 

halted. A. Shibutani, H. Suda, and F. Adachi, Decoding- The present invention is directed to a structure and 

complexity Reduction On Turbo-CRC Concatenated Code in method of implementing a direct comparison adaptive halt- 
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ing algorithm and decoder associated with iterative turbo means a single input, single output device that takes 

decoding without resorting to use of a passively included sequences of symbols in a fixed alphabet and produces an 

CRC code. The soft output sequence observed at each output sequence of the identical symbols over the same 

iteration step contains information on three L-valued alphabet in a different temporal order. Then for an input 

sequences; the channel information, the a priori information 5 sequence x^ieZ to an interleave r, the output sequence y^ieZ 

and the extrinsic information. The channel information can be written as y^x^, where it is defined as an invertible 

sequence is constant during the iteration and thus does not function: jt:Z-*Z. 

have any information on the state of the convergence nec- In one t of ^ invenlion a method associated 

essary to halt the iteration process. Thus, the change of the structure are implemenled t0 provide a direct comparison 

sum of the a prion information and the extrinsic information 10 adaptive halli ng algorithm associated with iterative turbo 

sequences is observed during each iteration step The soft decoding lQ more efficienlly eslimale me slale of lhe ^ 

output sequence containing the channel information ver gence for a variable rate data communication signal, 

sequence is, however, referred to in order to estimate the ¥ A „ c iL • j j 

.\ c t u u i tt « In still another aspect of the invention, a method and 

state of the convergence, such as disclosed by Hagenauer et . A , . ^ r . t . - . ., ,. 

iu *-*u . . . c t . & , associated structure are implemented to provide a direct 

al. above. Th e sum of the a p rion information sequence and i< , , 1A . r . ... • *j 

t . — r-7 p c — — r~- « — companson adaptive halting algonthm associated with ltera- 

the extruisic mformation sequence contains accurate mfor- t . \ , , t. . , . . . . 44 c . 

-* n - — — 7-t - ttt — : -y— A tive turbo decoding to estunate the state of the convergence 

mation on the state oi the c onverge nce and thus is quan tized r . , ° , , ., c . . 

-r- r-. =: — : & — r — - J - of received communication signals devoid of passively 

into a binary sequence. Dunng an iteration, any changes of . j* j ^ ™^ j 

■ -r . ■ 1 — 3 j ♦ , j tu % embedded error detection, e.g. CRC, codes. 

the binary sequence are detected. The iteration process is & 

halted once this change can no longer be detected. The ^ In vet another as P ect of the invention, a method and 

foregoing detection at each iteration step can be easily associated structure are provided to implement a direct 

implemented by storing the reference sequence generated by companson adaptive halting algonthm associated with itera- 

a MAP decoder in each stage of a turbo decoder and Uve turbo ^coding to estimate the state of the convergence 

updating the stored reference sequence for each stage fol- of a data communication signal without the necessity of 

lowing each iteration step, which does not seriously increase 25 direct reference to soft output sequences, 

the hardware size of the decoder. In another aspect of the invention, a method and associ- 

The present iterative turbo decoding process utilizing the ated structure are provided to implement a direct comparison 

direct comparison algorithm is implemented by dividing adaptive halting algorithm associated with iterative turbo 

each iteration step into two stages. MAP-decoding is per- decoding to estimate the state of the convergence of a data 

formed at each stage of the iteration step. The MAP- 30 communication signal without requiring either a large 

decoding produces information sequences at each stage that memory capacity or a multiplier with a long word length, 

are then subsequently summed and quantized into binary Another aspect of the invention is associated with a direct 

sequences (reference sequences). The reference sequence at comparison adaptive halting algorithm iterative turbo 

the second stage of one iteration step is stored in a memory decoding procedure and structure in which the computa- 

location and then de-interleaved. The newly generated ref- 35 tional complexity of the decoders) can be reduced by about 

erence sequence at the first stage of the next iteration step is 50% over known iterative turbo decoder structures without 

directly compared with the foregoing de-interleaved refer- degradation in the BER and FER, to estimate the state of the 

ence sequence and then interleaved. At the second stage of convergence of a data communication signal, 

the iteration step, in the same way, the reference sequence Still another aspect of the invention is associated with a 

generated at the second stage by the MAP decoder is directly 40 direct comparison adaptive halting algorithm for turbo 

compared with the foregoing interleaved reference sequence decoding in which the computational complexity of the 

generated by the first stage MAP decoder. The iteration adaptive halting algorithm associated with a turbo decoder is 

process is then halted only if the reference sequences at the substantially reduced in comparison with those CRC-based 

first and the second stages of the iteration step correspond adaptive halting algorithms for turbo decoders known in the 

identically with those same reference sequences generated at 45 art. 

the preceding iteration step. Thus, the direct comparison BRIEF DESCRIPTION OF THE DRAWINGS 
halting algorithmic turbo decoder estimates the state 01 the 

convergence in only one iteration step and thus can quickly Other aspects and features of the present invention and 

determine the iteration step to be halted. The direct com- many of the attendant advantages of the present invention 

parison halting algorithmic turbo decoder can halt the itera- 50 wil1 De readily appreciated as the same become better 

tion earlier than CRC-based adaptive halting turbo decoders understood by reference to the following detailed descrip- 

or such decoders otherwise requiring use of passively tion when considered in connection with the accompanying 

embedded CRC codes so that the computational complexity drawings in which like reference numerals designate like 

of the turbo decoder can be further reduced. P ar *s throughout the figures thereof and wherein: 

As used herein, the following words have the following 55 FIG. 1 illustrates a turbo decoder structure suitable for 

meanings. The words "algorithmic software*' mean an algo- implementing direct comparison adaptive halting algorithms 

rithmic program used to direct the processing of data by a devoid of CRC codes in accordance with one prefened 

computer or data processing device. The words "data pro- embodiment of the present invention; 

cessing device" as used herein refer to a CPU, DSP, FIG. 2 is a flow diagram illustrating a direct comparison 

microprocessor, micro-controller, or other like device and an 60 adaptive halting algorithm associated with the turbo decoder 

interface system. The interface system provides access to the structure of FIG. 1, according to one preferred embodiment 

data processing device such that data could be entered and of the present invention; 

processed by the data processing device. The words "dis- FIG. 3(a) is a graph illustrating bit error rates (BER) and 

crete data" as used herein are interchangeable with "digi- forward error rates (FER) for the present method and 

tized data" and "digitized data" as used herein means data 65 structure, a method and structure referring to the decoded 

which are stored in the form of singularly isolated, discon- sequence, and a method and structure using 8 iteration steps 

tinuous data or digits. The word "interleaver" as used herein without adaptive halting; 
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FIG. 3(6) is a graph illustrating the average number of medium so configured causes a computer to operate in a 

iteration steps to convergence for the present method and specific and predefined manner to perform the functions 

structure and a method and structure using 8 iteration steps described herein. An example of one such type of computer 

without adaptive halting; and is a personal computer. 

FIG. 4 is a simplified block diagram of a parallel- * jjufidng again at FIG. 1, X(k) represents the received 

concatenated turbo encoder for rate 1/3. no j sy systematic sequence that contains the channel infor- 

While the above-identified drawing figures set forth alter- mation. Y(k) and Y'(k) represent the two noisy convolutional 

native embodiments, other embodiments of the present code sequences corresponding to the input information 

invention are also contemplated, as noted in the discussion. sequence and its interleaved sequence respectively. The 

In all cases, this disclosure presents illustrated embodiments 10 component k represents the time index for the symbol of the 

of the present invention by way of representation and not foregoing noisy sequences. The present method of turbo 

limitation. Numerous other modifications and embodiments decoding is performed as iterative decoding in which each 

can be devised by those skilled in the art which fall within iteration step is further divided into two stages. Each of the 

the scope and spirit of the principles of this invention. two stages of iterative decoding is associated with a desig- 

15 nated portion of the turbo decoder structure 100, e.g. portion 

DETAILED DESCRIPTION OF THE containing MAP Dec.l, scaler a, comparator output f, and 

PREFERRED EMBODIMENTS ^ ^ ^ noisy sys t em atic sequence X(k)and noisy 

FIG. 1 illustrates a turbo decoder structure 100 suitable convoluted Y(k) are decoded in the first stage of the iteration 

for implementing direct comparison adaptive halting algo- 20 ste P via MAP-Dec. 1 decoder 106 using the a priori infor- 

rithms in accordance with one preferred embodiment of the mation sequence L aprim Jk) 108 generated in the second 

present invention. A rate 1/3 turbo coding associated with stage of the preceding iteration step. This MAP-decoder 106 

one systematic code sequence and two convolutional code men generates the extrinsic information sequence L Extrinstc 

sequences are considered herein to describe the present W- The generated extrinsic information sequence h Extrinsic 

embodiments. The present invention is not so limited ^ 00 is scaled via scaler 110 and interleaved via interleaver 

however, and it shall be understood that while a rate 1/3 112 t0 generate a new a priori information sequence for the 

turbo coding is considered herein, such rate is considered for second stage of the iteration step. The new a priori infor- 

illustration purposes only and to better explain a particular mation sequence for the second stage of the iteration step as 

method and structure in accordance with one preferred wel1 as the interleaved channel information sequence X*(k) 

embodiment of the present invention. The two convolutional 30 and the convolutional code sequence Y'(k) are then used in 

code sequences are presumed to be generated in a transmit- me MAP-Dec.2 decoder 114 to implement the MAP- 

ter (not shown), by convolving the input sequence and its decoding necessary to generate the extrinsic information 

interleaved sequence in parallel such that the output symbols sequence formulating the a priori information sequence in 

are recursively determined. Generally, a decoder (discussed the following iteration step. The scaling factors a and p 

more fully below) receives the transmitted sequences as 35 associated with scalers 110, 116 respectively, are changed at 

received sequences and re-constructs the original data eacn iteration step using techniques familiar to those skilled 

source bit stream from the received data elements, which ^ toe art of iterative turbo decoding, and have values 

may have been corrupted by noise. pre-optimized to speed up the convergence of the iterative 

The present invention may be implemented in hardware decoding and to reduce the BER. These scaling factors are 

or software, or a combination of both. In a preferred 40 * mp ' nc ?l ly ^rmmcd Jind less than or equal to 1. A more 

embodiment, the functions of a turbo decoder designed in deta ^ d discussion of the scaling factors can be found m D. 

conformance with the principals set forth herein are imple- ? ivsalar ™ d R PoU /'\° n of Turbo Codes, TDA 

mented as one or more integrated circuits using a suitable R R/ 2 Jr 123, { Cl ^ Pasaden *> 

processing technology, e.g., CMOS. Ca r bf -> PP- 99-121 November, 1995 and the Berrou et al. 

. . . .... i_ • 1 reference discussed herein above. Both references are incor- 

As another example, the present invention may be ample- 45 . r . . „ .. - . rin 

. 1 « . 1 »■ porated by reference herein. Further, scaling factors of 1.0 

mented in computer programs, i.e. algorithms, executing on r „ ' 0= • ,i .Tj rn 5 -r. u 

, t v r A b to . . ' b generally achieve sumciently good BER performance 11 the 

programmable computers each comprising a data processor, wai»j j_/\'« 1 ;.. 4 . i « 1 

F f t f . . * * ... r A MAP decoderts) is implemented by the full algorithm dis- 

a data storage system, including both volatile and non- , j • T « ti 1.1 * ^ 1 1- t v 1 j t n • 

volatile memory and/or data storage devices, at least one c }** d ! n n L \ Bah f 1 ; ?' Co * 6 .' F f and J - *Ti 

, . j 1 . % • n j Optimal Decoding of Linear Codes for Minimizing Symbol 

input device, and at least one output device. Program code 50 „ r „ A rrr p ^ r c « , -Jz „Z 

. F . . . # \ . . t t ^ , u a r a u a Error Rate, IEEE Trans. Inf. Theory, vol. IT-20, pp. 

is applied to input data to perform the functions described ~ OA x , , . nnA - . , . J c , . 

. K* . v f . . F . P _ . . . f 284-287, March, 1974, incorporated by reference herein, 

herein and generate output information. The output mfor- Tr „ ' , , , t , . . 1 . 

r » j .1 However, Berrou etal. have shown that when a large number 

mation is (applied to one or more output devices ,n known of iterations ^ factors are often 

ashion. Each such program may be .mplementedm a h.gh » 

level procedural or object oriented programming language to 55 £ . , . Jr J a .. . ' ... . 

v . . 4U * * ti 7u factors less than 1.0 are effective to reduce bit error rates, 

communicate with a computer system. However, the pro- . „ r T ». Ari , 4 . c . * ! 

... « . . - 7 * especially for the Max Log-MAP algorithm, the soft output 

grams can be implemented in assembly or machine ,7 , ... , f c f 

f . r . . J T . * , Viterbi algorithm and the luce. Unless the scaling factors 

language it aes.ren in any case tne language may De a have va , ues smMei 

or lareer than 1.0, turbo decoders 

compiled or mterpreted language. Each such computer pro- BER performance without degradation; and halting 

gram is preferably stored on a storage media or device, e.g. 60 ./ . c \. 4 , , . . j j 

° AU r / j- 1 \ 1 1 1 l 1 -1 catena for the turbo decoding do not degrade the BER 

ROM or magnetic disk) readable by a general or special c & t» 

& 7 c ' c j performance, 

purpose programmable computer, for configuring and oper- r 

ating the computer when the storage media or device is read A discussion directed to MAP-decoders, the a priori 

by the computer to perform the procedures described herein. information sequence and the extrinsic information 

The inventive structure and methods may also be considered 65 sequence are immediately set forth herein below to provide 

to be implemented as a computer-readable storage medium, additional background directed to a better understanding the 

configured with a computer program, where the storage instant embodiment of the present invention. First, the log 
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p(ar-+i)+i > (*=- i)-i, 



P(X = ±1) = 



e *UX) 



Further, a rate 1/2 systematic convolutional code is now also 
used as an example. An information sequence is then defined 
as u^u^u^, . . . ,u^], u*e{l,-l} for k=l, . . . ,N, and a 
corresponding code word vector is defined as. c(u)=[c 1 (u), 
c 2 (u), • • • ,C2^u)],c„(u)e{l,-l} for n-1, . . . 2N. The set of 
all possible information sequences is further identified as U 
and an observation vector of the code word through an 
AWGN channel corresponding to the information sequence 
is defined as v=[v a ,v 2 , . . . %], The MAP decoder has two 
inputs, i.e. the apriori information sequence and the obser- 
vation vector, and two outputs, Le. the soft output sequence 
and the extrinsic information sequence. The apriori infor- 
mation sequence L ion (k) for k»l, . . . ,N is defined as the 
scaled extrinsic information sequence which is one of the 
previous outputs of the MAP decoder of the turbo decoder. 
Then by using a given apriori information sequence and 
observation, the MAP decoder computes the soft output 
sequence and the extrinsic information sequence. The soft 
output sequence is defined as 



i^oM = log- 



2N N 



4) 



z n* 



where 



p(v,lc») = 



■et/,»/ t =-i V j= l 



. anc 

1 + e ± ^ , r" icr *j ) 

1 



Note that E^ of the observation vector is assumed to be 1.0. 
Further, v„. is defined to be the observation of the systematic 
code bit c M .(u) corresponding to the information bit u*. The 
extrinsic information sequence is then defined as 



where 



X(k) = log- 



8 



likelihood ratio L(X) for a random variable Xe{l,-1} is 
defined as 



in agreement with Hagenauer et al., where P(X-±1) denotes 
the probability that the random variable X takes on the 
values +1 and -1, respectively. Then using 
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next MAP decoding. The scaling factor is generally equal to 
or slightly less than 1, as discussed herein before. 

The soft output sequence, e.g. L Safi0u J(ti) 118, associated 
with either stage of each iteration step can be seen to be 
produced by adding the three sequences; the a priori infor- 
mation sequence, the channel information sequence and the 
extrinsic information sequence. Each soft output sequence, 
e.g. h Sofi0u j(k) 118, is quantized into one bit via a respective 
quantizer 124, 126, to generate a binary sequence that 
corresponds to the decoded sequence in the associated stage 
of the iteration step. The decoded sequence in the second 
stage can be seen to be obtained by de-interleaving the 
quantized soft output sequence via a De-Interleaver 128 to 
account for the channel information sequence passing 
through Interleaver 130. 

During the iteration taking place in the above described 
adaptive halting turbo decoding process, the amplitude of 
the above described soft output gradually becomes larger; 
and the decoded sequence often becomes error-free after a 
few iteration steps. The decoded sequence therefore does not 
change by further iteration once the decoded sequence 
becomes error- free. Thus, the error-free decoded sequence 
can be detected simply by detecting when the decoded 
sequence is identical to one at the preceding iteration step. 
Such error-free detection techniques have limitations how- 
ever. For example, it is known that even the decoded 
sequence with errors is often unchanged through several 
successive iteration steps, especially in the case of turbo 
decoding associated with finite word length arithmetic. 
Application of the foregoing error-free detection technique 
in such circumstances would likely halt the iteration process 
too early, seriously degrading the BER. In view of the 
foregoing limitations associated with known turbo decoding 
structures and methods, it is important to also be able to 
estimate the state of the convergence during the iterative 
decoding process. The decoded bits 132, 134 can be seen to 
be generated by quantizing the soft output L Sofi0t4 j(k) shown 



40 



(9) 



The soft output L SoAO J$l) sequence thus comprises three 
information sequences, the a priori, the extrinsic and the 
channel information. The channel information sequence 
X(k) is constant during the iteration process, and thus has no 
45 information on the state of the convergence. The sequence 
comprising L fl ^„<k)+L^^ lc (k) is therefore more infor- 
mative on the state of the convergence than the soft output 
sequence. 

The turbo decoder structure 100 can be seen to also 
so generate the above described information sequence com- 
prising L^ nort (k)+L^ H ^ c (k) at each stage of the turbo 
decoder structure 100. These information sequences com- 
prising Kprtorfit)+L £x/rinjic (k) are subsequently quantized 



The extrinsic information sequence is then scaled, inter- 
leaved and used as the apriori information sequence in the 



_ ^apriori 

via quantizers 120 and 122 respectively to formulate binary 
55 sequences (quantized reference sequences). These quantized 
reference sequences at the first and second stages of the 
turbo decoder structure 100 and generated during an itera- 
tion step are compared with the respective reference 
sequences generated during a preceding iteration step. The 
60 iteration process is halted once the quantized reference 
sequences generated at the iteration step are identical to 
those generated at the preceding iteration step. The present 
direct comparison adaptive halting algorithm is achieved via 
the turbo decoder structure 100 to estimate the state of the 
convergence to halt the iteration process, even if the trans- 
mitted sequences are not encoded with error-detection 
codes. Since the present adaptive halting technique associ- 
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ated with the two stages of the turbo decoder structure 100 by the passively embedded CRC code during the iteration, 

does not directly refer to the soft output sequences having also discussed above. The above comparison used a CRC 

long word lengths as the halting criteria, the necessity for a code generated via a polynomial generator common to both 

large memory to accommodate storage of the soft output the present CRC-based technique and the decoded sequence 

sequences or a multiplier having long word lengths is 5 technique. The polynomial generator is represented by equa- 

negated. The present invention therefore possesses charac- tion (10) below. 

terktics that are advantageous over known adaptive halting ^ + ^ + «» + ^ + ^„»^«W + ^l (10) 
techniques and structures. With continued reierence to Mu. 

1, the reference sequence at the second stage of one iteration Further, the rate 1/3 turbo code disclosed in 3 rd Generation 

step is stored in a first memory location. The memory 10 Partnership Project (3GPP) Technical Specification, Physi- 

location can be a storage register within any suitable cal Layer General Description, June 1999, was used in the 

memory device, e.g. existing turbo encoder memory, storage instant comparison. The MAP-decoding in the turbo decoder 

registers or cells associated with a comparator element and was accomplished using a finite word length via application 

the like. The reference sequence is next de-interleaved in of the Max-Log MAP algorithm disclosed by Robertson et 

De-Interleaver 136. At the first stage of the next iteration 15 al. in A Comparison of Optimal and Sub-optimal MAP 

step, the newly generated reference sequence is directly Decoding Algorithms Operating in the Log Domain, Proc. 

compared with the foregoing de-interleaved reference ICC'95, pp. 1009-1013, June 1995. The Robertson et al. 

sequence via Comparator 140 and then interleaved in Inter- reference and the '3GPP* reference are incorporated by 

leaver 138. At the second stage of the iteration step, in the reference herein. The received signals X(k), Y(k) and Y'(k) 

same way, the reference sequence generated by the MAP 20 were scaled and quantized into 6 bit symbols. The extrinsic 

Dec. 2 decoder 114 is directly compared with the interleaved information symbols and the state metrics were quantized 

reference sequence generated by the MAP Dec.l decoder into 9 bit symbols within the present direct comparison 

106. Then, if any change of the reference sequence is not adaptive halting turbo decoder and then stored in memory, 

detected in the two comparisons, the iteration process is The scaling factors a and p, having finite word lengths, were 

halted. 25 changed at each iteration step with pre-optimized values to 

The present method then, represents a significant accommodate fast convergence of the iterative decoding 
advancement in the state of present art associated with such as discussed above. The physical layer disclosed in the 
adaptive halting algorithms and iterative turbo decoding 3 rd Generation Partnership Project (3GPP) Technical 
structures and methods. The hardware size requirements Specification referenced above was used to formulate a turbo 
associated with the present direct comparison adaptive halt- 30 encoder with eight states and an interleaver having a vari- 
ing turbo decoder structure 100, e.g. decoders, comparators, able symbol length between 320 and 5120 bits. The inter- 
registers and the like, are substantially insignificant in com- leaver for the above comparison had a symbol length of 
parison with the MAP decoders and interleavers associated 1171 bits. The foregoing parameters were then used to 
with known turbo decoders. Extra memory however, is evaluate the BER and FER of the decoder outputs at several 
required to store the binary reference sequence. Since the 35 E^/N^s of the additive white gaussian noise channel, 
turbo decoder 100 itself requires rather large memory The adaptive haltings via the present direct comparison 
requirements in order to store the received sequence and also adaptive halting algorithm can be seen to significantly 
the intermediate extrinsic information sequence, the addition reduce the BER and FER of the above decoder when 
of the far smaller memory required to store the binary contrasted with application of the above described decoded 
reference sequence does not render any type of serious 40 sequence adaptive halting algorithm. The BER and FER 
problem in practical applications. associated with the decoded sequence adaptive halting algo- 

F1G. 2 is a flow diagram illustrating the above described rithm are seriously degraded since they have a high E^/Nq 
direct comparison adaptive halting algorithm 200 associated error floor. This degradation is caused due to the fact that the 
with the turbo decoder structure 100 of FIG. 1, according to decoded sequence is not as informative on the state of the 
one preferred embodiment of the present invention. The 45 convergence since the decoded sequence also includes the 
scaling operations have been omitted to preserve simplicity channel information sequence that is constant during the 
of explanation. The sum of the a priori information sequence iteration process as discussed herein before. The reference 
L aprion {\a) and the extrinsic information sequence V. Extrinsic sequence, defined as the quantized version of h apricri (k)+ 
(k) is seen to be computed at each iteration step. Since the ^Extrmsu$)> ^ therefore seen as sufficient to know the state 
sum sequence is sufficiently informative on the state of the 50 of the convergence. The foregoing application of adaptive 
convergence, it can be quantized into a binary sequence and halting algorithms applied to a turbo decoder further con- 
observed for changes during the iteration. The iteration is firms that the reference sequence can thus be utilized to 
then halted when there is no longer any detectable change in accurately estimate the state of the convergence using the 
the binary sequence during two concatenated iteration steps. present direct comparison adaptive halting techniques. 

FIG. 3(a) is a graph illustrating bit error rates (BER) and 55 FIG. 3(b) is a graph illustrating the average number of 

forward error rates (FER) for 1) the present direct compari- iteration steps to convergence for 1) the present method and 

son adaptive halting method and structure, 2) a method and structure and 2) a method and structure using 8 iteration 

structure referring to the decoded sequence, and 3) a method steps without adaptive halting. The adaptive haltings via the 

and structure using 8 iteration steps without adaptive halt- direct comparison adaptive halting algorithm can be seen to 

ing. The effectiveness of the present structure and method 60 significantly reduce the average number of iteration steps 

can be demonstrated by simply comparing the present without causing degradation in the BER and/or FER when 

structure and method with a turbo decoder using the adap- compared with a decoder configured to complete 8 fill 

tive halting algorithm in which the decoded sequence, rather iteration steps. A closer look at FIG. 3(6) shows that the 

than the reference sequence, is used for the halting criterion. direct comparison adaptive halting decoder completed its 

The decoded sequence is obtained first by quantizing the soft 65 decoding process in about 4 iteration steps at E^/N^l .2 dB. 

output sequence into a binary sequence such as discussed Since the 8-step decoder completed its decoding process in 

herein above. Changes in the decoded sequence are detected 8 iteration steps at Ej/NqsI.2 dB, the present direct com- 
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parison adaptive halting decoder can be seen to require only (g) applying the first quantized reference sequence to a 

50% of the computational complexity of the 8-step adaptive first interleaver to generate an interleaved first quan- 

halting decoder. tized reference sequence; 

In summary explanation of the above, the present inven- (h) app i y ing the first quantized reference sequence to a 

lion can accurately estimate the state of the convergence for 5 first comparator element; 

transmitted sequences received and processed by an adap- . * . A . _ 

live halting turbo decoder, even when the transmitted (0 the interleaved first quantized reference 

sequences are not encoded with error-detection codes. sequence to a second comparator element; 

Because the present invention does not directly refer to any (j) storing the second quantized reference sequence in a 

soft output sequences, memory capacity requirements are lQ data storage location; 

not wasted to accommodate storage of soft output sequences / k \ applying the second quantized reference sequence to 

having long word lengths or multipliers having long word tfae second comparator element; 

lengths. This is a substantial advantage over known structure , . . , . , , 

and techniques associated with adaptive halting algorithms © applying the second quantized reference sequence to a 

for iterative turbo decoding. * ^ " first de-interleaver element to generate a de-interleaved 

This invention has been described in considerable detail 15 secood quantized reference sequence; 

in order to provide those skilled in the equalizer art with the (m) applying the de-interleaved second quantized refer- 

information needed to apply the novel principles and to ence sequence to the first comparator element; 

construct and use such specialized components as are ( n ) comparing the de-interleaved second quantized refer- 

required. In view of the foregoing descriptions, it should be ence sequence thc first quan tized reference 

apparent that the present invention represents a significant 20 sequence within the first comparator element; 

departure from the prior art in construction and operation. , . _ A . _ , 

However, while particular embodiments of the present W oompanng the interleaved first quantized reference 

invention have been described herein in detail, it is to be sequence with the second quantized reference sequent* 

understood that various alterations, modifications and sub- within the second comparator element; 

stitutions can be made therein without departing in any way 25 (p) repeating steps (a) through (o) until the compared 

from the spirit and scope of the present invention, as defined signals within the first and second comparator elements 

in the claims which follow. For example, although various are identical; and 

embodiments have been presented herein with reference to (q) gen erating substantially error-free decoded elements 

particular turbo decoder elements and associated when the compared signals within the first and second 

characteristics, the present inventive s nicUires and methods 3Q comparator elements are identical, 

are not necessarily limited to a particular turbo decoder ^ *V . nf AamA - „ amrntM ^ m „t 

architecture or set of characteristics as used herein. Depend- 2 : ™ e met , hod of itentively decod ng a sequence of 

ing upon the particular application, a decoder element can r * ceiv f ed sl f als according to cl«m 1 further comprising the 

mean a single element or any combination of decoder f P of th fi e ^ ™ c »fc™*">° ^ e °<* *» a 

, t i 0 # . „ Q „- „ i ant - 0 first scaler and a first interleaver to generate the second a 

elements, so long as the present direct comparison adaptive 

h It' an be reserved 35 prion mformation sequence. 

^haU^claimed is- 3 ' The metnod of iteratively decoding a sequence of 

1. A method oAteratively decoding a sequence of receiv f si f als a # ? ordin S '° claim 1 further comprising the 

. j • i i i step of applying the second extrinsic information sequence 

received signals, representative of systematic convolutional x * j , j j • > i , \ *u 

encoded elements generated by a parallel-concatenated to a second scaler and a second de-interleaver to generate the 

i c c • ■ , a- i A ^ * ; * 40 first a prion information sequence, 

encoder from a source of original digital data elements, into _ 4 . , _ . j . , , 

decoded elements corresponding to the original digital data 4 . ™ e me hod decodin S. ^TTn ° 

elements, the method comprising the steps of: received «g"f according to claim 1 wherein the step (q) of 

, v \ . • j • a £ J v/i \ generating substantially error-free decoded elements when 

(a) applying a received input information sequence X(k), ^ md si ls ^ the first and comparator 
a first received convolutional code sequence Y(k) cor- 45 ^ ^ the st of j m the 
responding to the input information sequence and a informalion seque nce X(k) and the first 
first a prion information sequence to a first probabihty- ^ {q & ^ combinatorial element ^ a 
based decoder to generate a first extnnsic information ^ ^ tQ te a ^ Soft0m informatioQ 
sequence; sequence. 

(b) applying an interleaved received input information 5Q 5 ^ method of iterative]v decoding a sequence of 
sequence X'(k), a second received convolutional code receiyed sj Js accordi to claim 4 wherein me step (q) of 
sequence Y(k) corresponding to the interleaved input generating substantially error-free decoded elements when 
mformation sequence, and a second a priori informa- me signals the first and comparator 
tion sequence to a second probability-based decoder to elements are identical further comprises the step of applying 
generate a second extrinsic information sequence; 55 me ^tlmed received input information sequence X'(k 

(c) applying the first a priori information sequence and the and the secood re f er ence sequence to a fourth combinatorial 
first extrinsic information sequence to a first combina- element and a fourth quantizer to generate a second SoftOut 
torial element to generate a first reference sequence; information sequence. 

(d) applying the first reference sequence to a first quan- 6. The method of iteratively decoding a sequence of 
tizer to generate a first quantized reference sequence; 60 received signals according to claim 1 wherein the step (p) of 

(e) applying the second a priori information sequence and repeating steps (a) through (o) comprises the step of apply- 
the second extrinsic information sequence to a second ing the generated first extrinsic information sequence to a 
combinatorial element to generate a second reference first pre-optimized scaler element such that the first pre- 
sequence; optimized scaler element is capable of resealing the gener- 

(f) applying the second reference sequence to a second 65 ated first extrinsic information sequence during each itera- 
quantizer to generate a second quantized reference tion step to generate a new first extrinsic information 
sequence; sequence. 
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7. The method of iteratively decoding a sequence of 
received signals according to claim 6 wherein the step (p) of 
repeating steps (a) through (o) further comprises the step of 
applying the generated second extrinsic information 
sequence to a second pre-optimized scaler element such that 5 
the second pre-optimized scaler element is capable of res- 
caling the generated second extrinsic information sequence 
during each iteration step to generate a new second extrinsic 
information sequence. 

8. A method of iteratively decoding a sequence of 10 
received signals, representative of systematic convolutional 
encoded elements generated by a parallel-concatenated 
encoder from a source of original digital data elements, into 
decoded elements corresponding to the original digital data 
elements, the method comprising the steps of: 

(a) providing a pair of decoder modules, each decoder 
module having a pair of received signal inputs, a 
feedback input, and an output, such that the output of 
each decoder module is coupled to the feedback input 
of each other decoder module; 

(b) applying a non-interleaved received signal sequence to 
the received signal inputs of one decoder module and 
an interleaved received signal sequence to the received 
signal inputs of the other decoder module, such that 
each decoder module generates an output sequence; 

(c) combining a feedback information sequence applied to 
each decoder module feedback input with its respective 
generated output sequence to provide a quantized ref- 
erence sequence associated with each decoder module; 

(d) applying 1) a quantized reference sequence associated 
with the decoder module receiving an interleaved sig- 
nal sequence and 2) an interleaved quantized reference 
sequence associated with the decoder module receiving 
a non-interleaved signal sequence to a second com- 
parator element; 

(e) applying 1) a quantized reference sequence associated 
with the decoder module receiving a non -interleaved 
signal sequence and 2) a de-interleaved quantized ref- 
erence sequence associated with the decoder module 
receiving an interleaved signal sequence to a first 
comparator element; and 

(f) generating substantially error-free decoded elements 
when the compared signals within each comparator are 
identical. 

9. The method of iteratively decoding a sequence of 
received signals according to claim 8 wherein the step (c) of 
combining a feedback information sequence applied to each 
decoder module feedback input with its respective generated 
output sequence to provide a quantized reference sequence 
associated with each decoder module further comprises the 
step of scaling the generated output of each decoder via a 
distinct adaptive scaler element associated with each 
decoder to generate a new feedback information sequence 
associated with each decoder. 

10. The method of iteratively decoding a sequence of 
received signals according to claim 8 wherein the step (f) of 
generating substantially error-free decoded elements when 
the compared signals within each comparator are identical 
comprises the step of applying the combined received signal 
sequence, feedback information sequence and generated 
output sequence associated with one of the decoder modules 
to a combinatorial element and a quantizer to generate a first 
decoded bit stream. 

11. The method of iteratively decoding a sequence of 65 
received signals according to claim 10 wherein the step of 
generating substantially error-free decoded elements when 
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the compared signals within each comparator are identical 
further comprises the step of applying the combined inter- 
leaved received signal sequence, feedback information 
sequence and generated output sequence associated with the 
other decoder module to a combinatorial element and quan- 
tizer to generate a second decoded bit stream. 

12. The method of iteratively decoding a sequence of 
received signals according to claim 8 wherein the step (c) of 
combining a feedback information sequence applied to each 
decoder module feedback input with its respective generated 
output sequence comprises the step of applying the com- 
bined feedback information sequence and generated output 
sequence associated with each decoder module to a combi- 
natorial element and quantizer associated with each decoder 
module respectively. 

13. A direct comparison adaptive halting turbo decoder 
comprising: 

a first probability-based decoder having at least two 
received signal inputs, a feedback signal input and a 
signal output, the first probability-based decoder con- 
figured to receive an input information sequence and a 
convolved input information sequence; 

a second probability-based decoder having at least two 
received signal inputs, a feedback signal input and a 
signal output, such that the first probability-based 
decoder signal output is coupled to the second 
probability-based decoder feedback signal input, and 
further such that the second probability-based decoder 
signal output is coupled to the first probability-based 
decoder feedback signal input, the second probability- 
based decoder configured to receive an interleaved 
input information sequence and an interleaved con- 
volved input information sequence; 

a first combinatorial element coupled to the first 
probability-based decoder and configured to generate a 
first reference sequence comprising a feedback infor- 
mation sequence and an output information sequence, 
both associated with the first probability-based 
decoder; 

a second combinatorial element coupled to the second 
probability-based decoder and configured to generate a 
second reference sequence comprising a feedback 
information sequence and an output information 
sequence, both associated with the second probability- 
based decoder; 

a first quantizer configured to receive the first reference 
sequence and generate a first quantized reference 
sequence; 

a first interleaver configured to receive the first reference 

sequence and generate an interleaved first quantized 

reference sequence; 
a second quantizer configured to receive the second 

reference sequence and generate a second quantized 

reference sequence; 
a first de-interleaver configured to receive the second 

quantized reference sequence and generate a 

de -interleaved second quantized reference sequence; 
a first comparator configured to receive the first quantized 

reference sequence and the de -interleaved second 

quantized reference sequence; and 
a second comparator configured to receive the second 

quantized reference sequence and the interleaved first 

quantized reference sequence. 

14. The direct comparison adaptive halting turbo decoder 
according to claim 13 further comprising a first scaler 
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element coupled to the signal output of the first probability- a second comparator having an input coupled to the 

based decoder and configured to scale a feedback signal to output of the second quantizer and further having an 

the second probability -based decoder. output; 

15. The direct comparison adaptive halting turbo decoder a second inter i eaver having a first input coup led to the 
according to claim 13 further comprising a second scaler 5 t Qf ^ fifSt quantizer and further having an 
element coupled to the signal output of the second outnut: 

probability-based decoder and configured to scale a feed- * 

back signal to the first probability-based decoder. a comparator having a first input coupled to the 

16. The direct comparison adaptive halting turbo decoder 0Ut P ut of *e second interieaver, a second input coupled 
according to claim 13 further comprising a third combina- 10 t0 the output of the second quantizer and further having 
torial element coupled to the first combinatorial element and an output; and 

the first quantizer. a second de-interleaver having an input coupled to the 

17. The direct comparison adaptive halting turbo decoder output of the second quantizer and having an output 
according to claim 16 further comprising a fourth combi- coupled to the second input of the first comparator, 
natorial element coupled to the second combinatorial ele- 15 21. The direct comparison adaptive halting turbo decoder 
ment and the second quantizer. of claim 2 o further comprising a first storage unit configured 

18. The direct comparison adaptive halting turbo decoder t0 store a quantized reference sequence associated with the 
according to claim 17 further comprising a third quantizer seC ond quantizer 

coupled to the third combinatorial element to generate a first n ^ ^ c arison ad tive haltin mrbo decoder 

decoded bit sequence comprising the input information 20 21 ^ a secorjd st unit ^ 

seouence <=> 

" * ■ . j . . i_ l* • . * j , figured to store a quantized reference sequence associated 

19. The direct comparison adaptive halting turbo decoder ° " ^ 
according to claim 18 further comprising a fourth quantizer with the first quantizer. 

coupled to the fourth combinatorial element to generate a . 2 f \™« com P anson ^apUve halt * n S d f code < 

t _f, . . ]t co/infl _ „ rtmn - • „ tUo ■ • frtIWO of claim 22 further composing a third combinatorial element 

second decoded bit sequence comprising the input lniorma- 25,. _ 4 . , A c t . n , 

tion sequence having a first input coupled to the output or the first 

' 20. A direct comparison adaptive halting turbo decoder ^inatorial element and further haying a second input 

coupled to a received signal input of the first probability - 

comprising: L JJJ 

r)3secl decoder 

a first probability-based MAP decoder having two 24. Tne mrect comparison adaptive halting turbo decoder 

received signal inputs, a feedback input and an output; 30 of claim 23 ^her comprising a fourth combinatorial ele- 

a second probability-based MAP decoder having two ment having affirst input coupled to the output of the second 

received signal inputs, a feedback input and an output; combinatorial element and further having a second input 

a first scaler element having an output and further having coupled to a received signal input of the second probability- 

an input coupled to the output of the first probability- 35 based decoder. 

based MAP decoder; 25. The direct comparison adaptive halting turbo decoder 

a first interieaver having an input coupled to the output of of claim 24 further comprising a third quantizer having an 

the first scaler and further having an output coupled to m P ut coupled to the output of the third combinatorial 

the feedback input of the second probability-based element and further having an output. 

MAP decoder- 40 ^6. The direct comparison adaptive halting turbo decoder 

second scaler'element having an output and further of claim 25 , f " rther """prising a fourth quantizer having an 

having an input coupled to the output of the second m P m C0U P l f_ l ° th <; om P ut of lhe fourth combinatorial 



a 



probability-based MAP decoder; 



element and further having an output. 

. . . 27. The direct comparison adaptive halting turbo decoder 

a first de-mterleaver having an input coupled to the output of daim 26 furthef comprising a lhird de-interleaver having 

of the second scaler element and further having an * m m t kd tQ the QUt < of (he founh quantizer and 

output coupled to the feedback input of the first haying an QUtpm 

probability-based MAP decoder; 2g A comparison adaptive halting decoder, com- 

a first combinatorial element having an output and further prising 

having a first input coupled to the feedback input of the a tufbo deco(Jer confi d to receive an { t in f orma tion 

first probability-based MAP decoder and further having sequence, a convolved input information sequence and 

a second input coupled to the output of the first an interleaved convolved input information sequence; 

probability-based MAP decoder; and 

a second combinatorial element having an output and a ^ of comparators each comparator coupled to a 

further having a first input coupled to the feedback 55 Qne Qf ^ ^ decodefS ^ confi d to 

input of the second probability-based MAP decoder te decoded hM the decoded haU . 

and further having a second inpul coupled to the output fa sequences associated with sum sequence informa- 

of the second probabihty-based MAP decoder; ^ comprising solely of a priori and extrinsic 

a first quantizer having an input coupled to the output of sequence information, the decoded halting sequences 

the first combinatorial element and further having an 60 generated without direct reference to soft output 

output; sequence information. 

a second quantizer having an input coupled to the output 29. The direct comparison adaptive halting decoder 

of the second combinatorial element and further having according to claim 28 wherein the turbo decoder is further 

an output; configured to determine a change in the sum sequence 

a first comparator having a first input coupled to the 65 information associated with contiguous iterations, 
output of the first quantizer and further having a second 

input and an output; ***** 
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